Unfolding the procedure of characterizing recorded ultra low frequency, kHZ and MHz 
electromagetic anomalies prior to the L'Aquila earthquake as pre-seismic ones. Part I 
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Ultra low frequency, kHz and MHz electromagnetic anomalies were recorded prior to the L'Aquila 
catastrophic earthquake that occurred on April 6, 2009. The main aims of this contribution are: 

(i) To suggest a procedure for the designation of detected EM anomalies as seismogenic ones. We 
do not expect to be possible to provide a succinct and solid definition of a pre-seismic EM emis- 
sion. Instead, we attempt, through a multidisciplinary analysis, to provide elements of a definition. 

(ii) To link the detected MHz and kHz EM anomalies with equivalent last stages of the L'Aquila 
earthquake preparation process, (iii) To put forward physically meaningful arguments to support a 
way of quantifying the time to global failure and the identification of distinguishing features beyond 
which the evolution towards global failure becomes irreversible. The whole effort is unfolded in 
two consecutive parts. We clarify we try to specify not only whether or not a single EM anomaly 
is pre-seismic in itself, but mainly whether a combination of kHz, MHz, and ULF EM anomalies 
can be characterized as pre-seismic one. In the present first part, we focus on the detected kHz 
EM anomalies which play a crucial role to the approach of the above mentioned challenges. More 
precisely, we try to clearly discriminate this anomaly from the noise. For this purpose, we succes- 
sively analyze the data in terms of various concepts of entropy and information theory: Shannon 
n-block entropy, conditional entropy, entropy of the source, Kolmogorov- Sinai entropy, T-entropy, 
approximate entropy, fractal spectral analysis, R/S analysis and detrended fluctuation analysis. We 
argue that this analysis reliably recognize the candidate kHz EM precursor from the noise. This 
hypothesis is supported by the fact that the crucial precursory symptoms included in the candidate 
precursors are also hidden in other different, in their nature, complex catastrophic events, as it is 
predicted by the theory of complex systems. 

PACS numbers: 
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I. INTRODUCTION 

A catastrophic earthquake (EQ) of magnitude Mw — 
6.3 occurred on April 6 2009 (Olh 32m 41s UTC) in cen- 
tral Italy. This EQ was very shallow. The majority of 
the damage occurred in the city of L'Aquila. 

A vital problem in material science and in geophysics 
is the identification of precursors of macroscopic defects 
or shocks. The EQs are nothing but physical phenom- 
ena, namely large scale fractures, and science should have 
some predictive power on their future behaviour as for 
any physical system. 

Earthquakes physicists attempt to link the available 
observations to the processes occurring in Earth's crust. 
Fracture induced physical fields allow a real-time moni- 
toring of damage evolution in materials during mechani- 
cal loading. When a material is strained, electromagnetic 
(EM) emissions in a wide frequency spectrum ranging 
from kHz to MHz are produced by opening cracks, which 
can be considered as the so-called precursors of general 
fracture. These precursors are detectable both at a labo- 
ratory and a geological scale (Bahat et al., 2005; Eftaxias 
et al., 2007a; Hayakawa and Fujinawa,1994, Hayakawa, 
1999; Hayakawa and Molchanov, 2002). 

Since 1994, a station has been installed and operated at 



a mountainous site of Zante island (37.76°iV— 20.76°i?) in 
the Ionian Sea (western Greece) . The aim of this station 
is the detection of EM precursors. Clear ultra low fre- 
quency (ULF), kHz, and MHz EM precursors have been 
recently detected over periods ranging from a few days 
to a few hours prior to recent catastrophic EQ that oc- 
curred in Greece. We emphasize that the detected precur- 
sors were associated with EQs: (i) that occurred in land 
(or near coast-line); (ii) were strong, i.e., with magnitude 
6 or larger; and (iii) shallow (Contoyiannis et al., 2005; 
Karamanos et al., 2006). Recent results indicate that the 
recorded EM precursors contain information characteris- 
tic of an ensuing seismic event (e.g., Eftaxias et al., 2002, 
2004, 2006, 2007; Kapiris et al., 2004, 2005; Contoyiannis 
et al., 2005; Contoyiannis and Eftaxias, 2008; Kalimeri 
et al., 2008; Papadimitriou et al., 2008). 

The L'Aquila EQ occured in land, was very shallow 
and its magnitude was larger than 6. MHz, kHz and 
ULF EM anomalies were observed before this EQ. No- 
tice, an important feature, which is observed both at a 
laboratory and a geological scale, is that the MHz radi- 
ation appears earlier than the kHz one (Eftaxias et al., 
2002 and references therein). The detected anomalies 
followed this temporal scheme: 

(i) The MHz EM anomalies were detected on 26 March, 
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2009 and April 2 2009. 

(ii) The kHz EM anomalies were emerged on April 4, 
2009. 

(iii) The ULF EM anomaly was continuously recorded 
from March 29, 2009 up to April 2, 2009. 

A question naturally arises is whether the recorded 
anomalies are seismogenic or not. 

We emphasize that the used experimental setup gives 
us the possibility to specify not only whether or not a 
single kHz, MHz, or ULF EM anomaly is pre-seismic in 
itself, but mainly whether a combination of such kHz, 
MHz, and ULF anomalies can be characterized as pre- 
seismic. 

Some key questions in this field of research are: 

(i) How we can recognize an EM observation as a pre- 
seismic one. We wonder whether necessary and sufficient 
criteria have been yet established that permit to charac- 
terize an EM observation as a real EM precursor. 

(ii) How we can link an individual EM precursor with 
a distinctive stage of EQ preparation. 

(iii) How we can identify precursory symptoms in EM 
observations that witness that the occurrence of the pre- 
pared EQ is unavoidaMe. 

Herein, we try to study the possible seismogenic origin 
of the recorded anomalies prior to the L'Aquila EQ in 
the frame of the above mentioned open key questions: 

(i) A main aim of this contribution is to suggest a pro- 
cedure for the designation of the detected EM anomalies 
as seismogenic ones. We do not expect to be possible to 
provide a succinct and solid definition of a pre-seismic 
EM emission. Instead, we attempt, through a multidisci- 
plinary analysis, to provide elements of a definition. 

(ii) We attempt to link the detected MHz and kHz 
EM anomalies with the equivalent two last stages in the 
L'Aquila EQ preparation process. 

(iii) We attempt to put forward physically meaningful 
arguments to support a way of quantifying the time to 
global failure and the identification of distinguishing fea- 
tures beyond which the evolution towards global failure 
becomes irreversible. 

Notice, recent studies have provided a relevant experi- 
ence (e.g., Kapiris et al., 2004; Contoyiannis et al., 2005, 
2008; Papadimitriou et al., 2008; Eftaxias et al., 2006, 
2007). This experience encourages this effort and gives 
us the possibility to verify results of this present study 
with previous ones. 

In the present Part I of this investigation we restrict 
our study in the designation of the detected kHz EM 
anomaly prior to the L'Aquila EQ as seismogenic one. 
In Part II we focus on the remaining key open questions. 
In the following we present our plan. 

Anomaly in a recorded time series is defined as a de- 
viation from the normal behaviour. In order to develop 
a quantitative identification of EM precursors, first con- 
cepts of entropy and tools of information theory are used 
in order to identify statistical patterns. It is expected 
that, a significant change in the statistical pattern rep- 
resents a deviation from the normal behaviour revealing 



the presence of an anomaly. Symbolic dynamics pro- 
vides a rigorous way of looking at "real" dynamics. First, 
we attempt a symbolic analysis of experimental data in 
terms of Shannon n-block entropy, conditional entropy, 
entropy of the source, Kolmogorov-Sinai entropy, and 
T-entropy. It is well-known that the Shannon entropy 
works best in dealing with systems composed of either 
independent subsystems or interacting via short-range 
forces, and whose subsystems can access all the available 
phase space. For systems exhibiting long-range correla- 
tions, memory, or fractal properties, Tsallis' entropy be- 
comes the most appropriate mathematical tool (Tsallis, 
1998; 2009). A central property of the EQ preparation 
process is the possible occurrence of coherent large-scale 
collective with a very rich structure, resulting from the 
repeated nonlinear interactions among collective with a 
very rich structure, resulting from the repeated nonlin- 
ear interactions among its constituents (Sorncttc, 1999). 
Consequently, the Tsallis entropy is an appropriate tool 
to investigate the launch of EM precursor. The Tsallis 
entropy is also used. 

All the techniques based on symbolic dynamics sensi- 
tively discriminate the recorder kHz EM anomalies from 
the EM background: they are characterized by a signifi- 
cantly lower complexity (or higher organization). 

We analyze the data by means of Approximate En- 
tropy {ApEn), which absolutely refers to the raw data, 
for comparison reasons. This analysis verify the results 
of symbolic dynamics. 

The fractal spectral analysis offers additional informa- 
tion concerning the signal/noise discrimination. Indeed, 
it: (i) Shows that the candidate kHz precursors follow the 
fractional Brownian motion (fBm)-model; on the con- 
trary, the EM background rather follows the 1/f- noise 
model, (ii) Implies that the candidate kHz EM precursor 
has persistent behaviour. The existence of persistency 
in the candidate precursors is confirmed by R/S analy- 
sis, while, the suggestion that the anomalies follow the 
fBm-model is verified by Detrended Fluctuation Analysis 

The simultaneous abrupt appearance of both high or- 
ganization (or low complexity) and persistency in the 
launched kHz anomalies implies that the underlying 
fracto-elcctromagnctic process is governed by a posi- 
tive feedback mechanism (Sammis and Sornette, 2002). 
Such a mechanism is consistent with a candidate pre- 
cursor, it can be the result of stress transfer from dam- 
aged to intact entities ot it can result from the effect 
of damage in lowering the local elastic stiffness (Sammis 
and Sornette, 2002). Notice, both result in finite-time- 
singularity. Such a singularity, in terms of "Benioff " type 
cumulative EM energy release , is hidden in the emerged 
kHz anomalies prior to L'Aquila EQ (see Part II). The ex- 
istence of finite-time-singularity in the anomalies strongly 
supports the hypothesis of presence of a positive feedback 
mechanism, which expresses a positive circular causality 
that acts as a growth-generating phenomenon and there- 
fore drives unstable patterns (Telesca and Lasaponara, 
2006). The appearance of the property of irreversibility 
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in a probable precursor is one of the important compo- 
nents of predictive capability (Morgounov, 2001). 

Earthquake occurrence is a complex phenomenon in 
space and time. The field of study of complex systems 
holds that the dynamics of complex systems is founded on 
universal principles that may used to describe disparate 
problems ranging from particle physics to the economics 
of societies. We verify the presence of crucial symp- 
toms that were appeared in the launched EM into other 
different, however, in their nature, catastrophic events, 
namely, epileptic seizures, magnetic storms, solar flares. 

The application of the above mentioned procedure sen- 
sitively recognizes and discriminates the candidate kHz 
EM precursors from the EM background. Importantly, 
it extracts universal catastrophic features from the can- 
didate kHz EM precursors. 

However, in the end of this procedure, we report a neg- 
ative answer to the question whether the extracted symp- 
toms, which have been well established and are rooted in 
a solid physical base, constitute not only a necessary but 
also a sufficient framework in order to characterize the 
anomalies as pre-seismic ones. 

More effort is needed, which is presented in the follow- 
ing Part II of this contribution. 

The paper is organized as follows. Section 2 briefly 
describes the configuration of the station. It also 
presents the candidate ULF, kHz and MHz EM precur- 
sors, and discusses a possible their correlation with mag- 
netic storm, solar flare or atmospheric activity. Section 

3 introduces the notion of symbolic dynamics. Section 

4 provides a brief overview of (Shannon-like) n-block 
entropy, differential or conditional entropy, entropy of 
the source or limit entropy, and Kolmogorov-Sinai en- 
tropy, as well as the corresponding application of the 
aforementioned tools to the data. Section 5 provides a 
brief overview of nonextensive Tsallis entropy and the 
extracted information from the data. Section 6 briefly 
introduces the notion of T-entropy and presents the as- 
sociated results. Sections 7 presents the notion of ApEn 
and the corresponding application to the data. In Sec- 
tions 8, 9 and 10, the fractal spectral analysis R/S anal- 
ysis and fractal detrended analysis (DFA) are applied to 
the data. Section 11 discusses the extracted results in 
terms of theory of complex systems. Finally, Section 12 
summarizes and concludes the paper. The conclusions 
are finalized with the question: which is the next step? 



II. DATA PRESENTATION 

Since 1994, a station was installed at a mountainous 
site of Zante island {^1 .76°N -2Q.1&°E) in the Ionian Sea 
(western Greece) with the following configuration: (i) six 
loop antennas detecting the three components (EW, NS, 
and vertical) of the variations of the magnetic field at 3 
kHz and 10 kHz respectively; (ii) two vertical A/2 electric 
dipoles detecting the electric field variations at 41 and 54 
MHz respectively ,and (iii) two Short Thin Wire Anten- 



nas (STWA) of 100 m length each, lying on the Earth's 
surface, detecting ultra low frequency (ULF) (< 1 Hz) 
anomalies, at EW and NS direction respectively. The 3 
kHz, 10 kHz, 41 MHz, and 54 MHz were selected in order 
to minimize the effects of the sources of man-made noise 
in the mountain area of the Zante island. All the EM 
time-series were sampled at 1 Hz. 

A sequence of MHz, kHz and ULF EM anomalies were 
observed before the L'Aquila EQ, as follows: 

(i) MHz EM anomalies. EM anomalies were simulta- 
neously recorded at 41 MHz and 54 MHz by the electric 
dipoles on March 26, 2009 and April 2, 2009. Fig. 1 
shows the excerpts of the recorded anomalies by the 41 
MHz electric dipole, which show critical behavior. Phys- 
ical powerful arguments by means of criticality seem to 
shed light on their seismogenic origin. Growing evidence 
suggests that rupture in strongly disordered systems can 
be viewed as a type of critical phenomenon (Herrmann 
and Roux, 1990; Sornette and Andersen, 1998). In the 
Part II of this contribution, we show that the presented 
in Fig. 1 excerpts of the recorded MHz emission could 
be described in analogy with a thermal continuous (sec- 
ond order) phase transition. In this field of research the 
reproducibility of results is desirable. The resulted criti- 
cal character of the MHz EM anomalies is striking sim- 
ilar to that observed in previously detected MHz EM 
seismogenic activities (Contoyiannis et al., 2005; Con- 
toyiannis and Eftaxias, 2008). The family of asperities 
distributed along a fault sustains the system. We ar- 
gue that the emerged MHz anomalies could be triggered 
by fractures in the highly disordered system that sur- 
rounded the "backbone of asperities" of the activated 
L'Aquila fault (Kapiris et al., 2004; Contoyiannis et al., 
2005, Contoyiannis and Eftaxias, 2008). 

(ii) kHz EM anomalies. A sequence of strong multi- 
peaked EM bursts, with sharp onsets and ends, were si- 
multaneously recorded by the 3 kHz and 10 kHz loop 
antennas on April 4, 2009. Fig. 2a shows the recorded 
EM anomalies by the 10 kHz (E-W) loop antenna. These 
anomalies are launched over a quiescence period concern- 
ing the detection of EM disturbances at the kHz fre- 
quency band (Fig. 2b). Fig. 3 depicts magnified im- 
ages of the excerpts N, Bl, B2 and B3 that are shown 
in fig. 2 (a). We argue that their seismogenic origin is 
strongly supported by a multidisciplinary analysis. In re- 
cent works we suggested that the kHz EM precursors are 
rooted in the fracture of asperities of the activated fault 
(Kapiris et al., 2004; Contoyiannis et al., 2005; Eftaxias 
et al, 2007b, Eftaxias et al., 2008, Contoyiannis and Ef- 
taxias, 2008; Papadimitriou et al., 2008). The present 
analysis is consistent with the hypothesis that the de- 
tected kHz EM anomalies are possibly associated with 
the fracture of asperities that were distributed along the 
L'Aquila fault. 

(iii) ULF EM anomaly. An ULF EM anomaly was 
recorded by the STWA sensors (Fig. 4). The daily pat- 
tern of the ULF recordings during the normal period, 
i.e., far from the EQ occurrence, follows a rather peri- 
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odical variation which is characterized by the existence 
of a clear minimum. Someone finds a clear alteration 
of the normal daily profile as the shock approaches; the 
"depth" of minimum is significantly decreases. The curve 
attains its normal shape a few days after the event. No- 
tice, more clear but similar anomalies were also detected 
prior to significant EQs in Greece. They had the same 
morphology and also emerged a few days before the en- 
suing EQ (Eftaxias et al., 2000, 2002, 2004; Karamanos 
et al., 2006). 

The appearance of this anomaly may support the hy- 
pothesis of a relationship between processes produced 
by increasing tectonic stresses in the Earth's crust and 
attendant EM interactions between the crust and iono- 
sphere. 

We emphasize that we have expressed very clearly our 
point of view that the occurrence of an anomaly in the 
output of a sensor does not qualify it as a precursor 
(Karamanos et al., 2006; Papadimitriou et al., 2008). 
The morphology of the recorded ULF signal does not give 
us the possibility to evaluate their seismogenic origin in 
terms of a rather austere set of criteria as it happens in 
the cases of the kHz and MHz EM activities. The po- 
tential seismogenic origin of the recorded ULF signal is 
only based on empirical arguments from our side, thus, 
we consider this anomaly as hypothetical precursory ULF 
EM emission. 

We note that all the recorded EM anomalies have 
been recorded during a quiet period in terms of magnetic 
storm, solar flares and atmospheric activity. The consec- 
utive appearance of ULF, MHz and kHz EM anomalies 
in a time interval a few days prior to the L'Aquila EQ oc- 
currence rather excludes the possibility that the recorded 
anomalies were man-made noises. 



III. FUNDAMENTALS OF SYMBOLIC 
DYNAMICS 

For reasons of completeness and for later use, we com- 
pile here the basic points of symbolic dynamics. 

Symbolic time series analysis is a useful tool for mod- 
elling and characterization of nonlinear dynamical sys- 
tems (Voss et al., 1996). It provides a rigorous way of 
looking at real dynamics with finite precision (Hao, 1989, 
1991; Kitchens, 1998; Karamanos and Nicohs, 1999). It 
is a way of coarse-graining or reduction of description. 

The basic idea is quite simple. One divides the phase 
space into a finite number of partitions and labels each 
partition with a symbol (a letter from some alphabet). 
Instead of representing the trajectories by infinite se- 
quences of numbers-iterates from a discrete map or sam- 
pled points along the trajectories of a continuous flow, 
one watches the alteration of symbols. Of course, in so 
doing, one loses an amount of detailed information, but 
some of the invariant, robust properties of the dynam- 
ics may be kept, e.g. periodicity, symmetry, or chaotic 
nature of an orbit (Hao, 1991). 



In the frame of symbolic dynamics the time series are 
transformed into symbolic sequences by using very few 
symbols based on an appropriate partition. After sym- 
bolization, the next step is the construction of symbols 
sequences (words in the symbolic-dynamics literature) 
from the symbol series by collecting groups of symbols 
together in temporal order. 

To be more precise, the simplest possible coarse- 
graining of a time series is given by choosing a thresh- 
old C (usually the mean value of the data considered) 
and assigning the symbols "1" and "0" to the sig- 
nal, depending on whether it is above or below the 
threshold (binary partition). Thus, we generate a sym- 
bolic time series from a 2-letter (A = 2) alphabet 
(0,1), e.g. 0110100110010110.... We read this sym- 
bolic sequence in terms of distinct consecutive "blocks" 
(words) of length n = 2. In this case one obtains 
01/10/10/01/10/01/01/10/ .... We cafl this reading pro- 
cedure "lumping" . The number of all possible kinds of 
words is A" = 2^ = 4, namely 00, 01, 10, 11. 

The required probabilities for the estimation of an en- 
tropy. Poo, Poi, Pw, Pii are the fractions of the blocks 
(words) 00, 01, 10, 11 in the symbolic time series, namely, 
0, 4/16, 4/16, and 0, correspondingly. Based on these 
probabilities we can estimate, for example, the prob- 
abilistic entropy measure Hs introduced by Shannon 
(1948): 

Hs = -"^Pilnpi (1) 

where pi are the probabilities associated with the mi- 
croscopic configurations. 

Various tools of information theory and entropy con- 
cepts are used to identify statistical patterns in the sym- 
bolic sequences, where the dynamics of the original (un- 
der analysis) system has been projected. For anomaly 
detection, it suffices that a detectable change in the pat- 
tern represents a deviation of the nominal behaviour from 
an anomalous one (Graben and Kurths, 2003). Recent 
literature has reported novel methods for anomaly detec- 
tion in complex dynamical systems, which relies on sym- 
bolic time series analysis. Entropies depending on the 
word-frequency distribution in symbolic sequences are of 
special interest, extending Shannon's classical definition 
of the entropy and providing a link between dynamical 
systems and information theory. These entropies take a 
large (small) value if there are many (few) kinds of pat- 
terns, therefore, it decreases while the organization of 
patterns is increasing. In this way, these entropies can 
measure the complexity of a signal. 

It is important to note that one cannot find an opti- 
mum organization or complexity measure (Kurths et al., 
1995). We guess that a combination of some such quan- 
tities which refer to different aspects, such as structural 
or dynamical properties, seems to be the most promis- 
ing way. Thus, several well-known techniques have been 
applied to extract EM precursors probably hidden in kHz 
EM time series. 
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We analyze the EM time scries by the following tech- 
niques which are based on symbolic dynamics: (i) Shan- 
non n-block entropy; (ii) differential or conditional en- 
tropy; (iii) limit entropy, (iv) Kolmogorov-Sinai entropy; 
(v) T-entropy, and finally (vi) Tsallis entropy. . 



IV. THE CONCEPT OF DYNAMICAL 
(SHANNON-LIKE) n-BLOCK ENTROPIES 

Block entropies, depending on the word-frequency dis- 
tribution, are of special interest, extending Shannon's 

classical definition of the entropy of a single state to the 
entropy of a succession of states (Nicolis and Gaspard, 
1994). Generally, these entropies take a large (small) 
value if there are many (few) kinds of patterns, there- 
fore, it decreases while the organization of patterns is 
increasing. In this way, the block entropy can measure 
the complexity of a stationary signal. 

Symbol sequences, {y4.i...A„...Ai}, are composed 
of letters from an alphabet consisting of A letters 
{.4(1). An English text is written on an al- 

phabet consisting of 26 letters {A, B, C...X, Y, Z}. 

A word of length n < L, {Ai...An}, is defined by a 
substring of length n taken from {Ai...^„...Al}. The 
total number of different words of length n which exists 
in is 

Nxr^ = A". 

We specify that the symbolic sequence is to be read in 
terms of distinct consecutive "blocks" (words) of length 
n, 



H{n) = - P^''\Ai,-,An)Anp(^\Au...,An) 

(^i,...,A„) 

(4) 

The entropy Hn is a measure of uncertainty and gives 
the average amount of information necessary to predict a 
sub-sequence of length n . 

(ii) The Shannon n-block entropy per letter 

This entropy is defined by 

= (5) 

n 

These entropies may be interpreted as the average un- 
certainty per letter of an n-block. 
(ii) The conditional entropy 

Prom the Shannon n-block entropies we derive the con- 
ditional (dynamic) entropies by the definition 

h(r,)=H{n+l)-H{n). (6) 

The conditional entropy hn measures the uncertainty 
of predicting a state one step in the future, provided a 
history consisting of n-states, namely, the present state 
and the previous n — 1 states. 

Predictability is measured by conditional entropies. 
For Bernoulli sequences we have maximal uncertainty 

h{n) = log{\). (7) 
Therefore we define the difference 



... Ai..^AnAn+l...A2n ... Ajn+l--A(^j^i)n ■■■ (2) 

As it is said, we call this reading procedure lumping. 
Gliding is the reading of the symbolic sequence using 
a moving frame. It has been suggested that in some 
cases the entropy analysis by lumping is much more sensi- 
tive than the classical entropy analysis by gliding (Kara- 
manos, 2000, 2001). 

The probability of occurrence of a block Ai...An, de- 
noted p("')(Ai, ...,An), is defined by the fraction 

No. of blocks, Ai...An, encountered when lumping 
total No. of blocks 

(3) 

starting from the beginning of the sequence. 

The following quantities characterize the information 
content of the symbolic sequence (Khinchin, 1957; Ebel- 
ing and Nicolis, 1992): 

(i) The Shannon n-block entropy 

Following Shannons approach (Shannon, 1948) the n- 
block entropy, is given by 



r„ = log{X) - hn (8) 

as the average predictability of the state following after 
a measured n-trajectory. In other words, predictability is 
the information we get by exploration of the next state in 
the future in comparison to the available knowledge. 

We use in most cases A as the units of the logarithms. 
In these units the maximal uncertainty/predictability is 
one (Ebcling, 1997). 

In general our expectation is that any long-range mem- 
ory decreases the conditional entropies and improves the 
changes for predictions. 

(iii) The entropy of the source 

A quantity of particular interest is the entropy of the 
source defined as 

h = lim h(n) = hm h^''^ (9) 

n — *oo n — >oo 

The limit entropy h is the discrete analog of 
Kolmogorov-Sinai entropy. It is the average amount of 
information necessary to predict the next symbol when 
being informed about the complete pre-history of the sys- 
tem. Since positive Kolmogorov-Sinai entropy implies 
the existence of a positive Lyapunov exponent, it is an 
important measure of chaos. 
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A. Application to the data 

The upper panel in Fig. 5 shows the entropies per- 
formed by hmping. Wc recall that Ivmping. Is the read- 
ing of the symbolic sequence by taking portions^ as op- 
posed to gliding where one has essentially a moving frame. 
The lower panel depicts the entropies estimated by glid- 
ing. We observe that both two methods of reading lead 
to consistent results. 

The Shannon n-block entropy. Figs. 5a depict the 
Shannon n-block entropy, Hn, as a function of the word 
length n for the time windows N, Bl, B2, and B3 (see 
Fig. 3). The noise N is characterized by significantly 
larger if„ -values. 

This means that the average amount of information 
necessary to predict a sub-sequence of length n is larger 
in the noise than in the bursts Bl, B2, and B3 is. 

The Shannon n-block entropy per letter. Figs. 5b show 
that the average uncertainty per letter of an n-block is 
larger in the noise than in the excerpts Bl, B2, and B3 
is. 

The conditional entropy. Figs. 5c illustrate the 

conditional entropies, /i„, as a fimction of the word length 
n for the excerpts under study. The noise N has signifi- 
cantly higher /i„-values. 

This means that the uncertainty of predicting a state 
one step in the future, provided a history of the present 
state and the previous n — 1 states is higher in the case 
of noise N or, in terms of predictability, the average 
predictability of the state following after a measured n- 
trajectory is higher in the bursts Bl, B2, and B3. We re- 
call that any long-range memory decreases the conditional 
entropies and improves the changes for predictions. 

The entropy of the source. One important conjec- 
ture, due essentially to Ebeling and Nicolis (1992), states 
that the most general (asymptotic) scaling of the block 
entropies takes the form 

H{n) = e + nh + gn''" {Inn)"' (10) 

where e and g are constants and /xq and /Ui are constant 
exponents. 

The former equation is transformed to the simple linear 
relation 

H{n) = e + nh (11) 

due to the observed rather linear scaling in Figs. 5a. 
The associated slope h could be considered as the limit 
entropy, which gives the Kolmogorov-Sinai entropy. The 
former takes values from zero to In 2. Thus, one can 
normalize dividing the /i-values by In 2 obtaining a per- 
centage. 

Fig. 5a (upper panel) show that there is a clear-cut 
distinction of the values of the slopes h, that suggest a 
significant difference in the corresponding Kolmogorov- 
Sinai entropies (see Fig 5d, upper panel). 



We focus on the entropies estimated by gliding (Fig. 
5, lower panel). 

In Fig. 5d we show the Kolmogorov- Sinai entropy 

estimated by: 

(i) the slope of i?„ versus n (Fig. 5a). The associ- 
ateD values of Kolmogorov-Sinai entropy are shown by 
the solid columns in Fig. 5d. 

(ii) using the relation 

h = lim (12) 

n—*OG 

via the asymptotic behaviour of the Shannon n- 
block entropy per letter depicted in Fig. 5b). These 
Kolmogorov-Sinai-entropy values are shown in Fig. 5d 
(dotted columns). We clarify that the estimated values 
are indicative ones. 

We systematically observe a drop of the entropy of the 
source in the bursts Bl, B2 and B3. 

This implies that the average amount of information 
necessary to predict the next symbol when being inform,ed 
about the complete pre-history of the system significantly 
decreases in the emerged candidate precursors in respect 
to the noise. 

The question which arises is whether the observer lin- 
ear scaling in Figs. 5a is an algorithmic law of nature. 
This is an open problem. 

In summary, the various kind of block entropies, which 
quantifies dynamic aspects of a time series in a sta- 
tistical manner, sensitively recognizes and discriminates 
the emerged strong EM precursors from the background 
noise. They suggest that the memory (or compressibil- 
ity) in the bursts Bl, B2, and B3 is significantly larger 
in comparison to that of the noise N. 



V. PRINCIPLES OF NON-EXTENSIVE 
TSALLIS ENTROPY 

In Introduction, we explained why physical systems 
that are c;liaraeterized by long-range interactions, long- 
term memories, or multi- fractal nature, are best de- 
scribed by a generalized statistical mechanics' formalism 
that was proposed by TsaUis (1998, 2009). More pre- 
cisely, inspired by multifractals concepts, TsaUis (1988, 
1998) proposed a generalization of the Boltzmann-Gibbs 
(B-G) statistical mechanics. He introduced an entropic 
expression characterized by an index q which leads to a 
non-extensive statistics, 



where pi are the probabilities associated with the mi- 
croscopic configurations, W is their total number, g is a 
real number, and k is Boltzmann's constant. 
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The cntropic index q describes the deviation of TsaUis 
entropy from the standard Boltzmann-Gibbs one. In- 
deed, using p^^""^^ = e(«-i)'"(f*) ~ 1 + (g - l)ln(pi) in 
the hmit g ^ 1, we recover the usual Boltzmann-Gibbs 
entropy 



w 



(14) 



This is the basis of the so called non-extensive statis- 
tical mechanics, which generalizes the Boltzmann-Gibbs 
theory. 

The entropic index q characterizes the degree of non- 
aextensivity reflected in the following pseudo-additivity 
rule: 



Sg{A + B)=Sg{A)+Sg{B) + {l-q)Sg{A)Sg{B). (15) 

For subsystems that have special probability correla- 
tions, extensivity 



Sb-G = SB-GiA) + SB-GiB) 



(16) 



is not valid for Sb-g-, but may occur for Sq with a par- 
ticular value of the index q. Such systems are sometimes 
referred to as non-cxtcnsivc (TsaUis, 1998; 2009). 

The cases q > 1 and q < 1, correspond to sub- 
additivity, or super-additivity, respectively. We may 
think of g as a bias-parameter: q < 1 privileges rare 
events, while q > 1 privileges salient events (Zunino et 
al., 2008). 

We empasize that the parameter q itself is not a mea- 
sure of the complexity of the system but measures the 
degree of iion-extcnsivity of the system. It is the time 
variations of the TsaUis entropy for a given q {Sq) that 
quantify the dynamic changes of the complexity of the 
system. Lower Sg values characterize the portions of the 
signal with lower complexity. 

In terms of symbolic dynamics the Tsallis entropy for 
the word length n is (Kalimeri et al., 2008): 



Sq{n) 



q-1 



{Ai,A 



X] \p{n)Ar,A2 

,An) 



(17) 



A. Application to the data 



Tsallis entropies arc computed using the technique of 
lumping for binary partition (with the mean value as 
threshold) and block (word) length n = 2. A detail cal- 
culation of the Tsalis entropies is given in Kalimeri et al., 
(2009). 



As TsaUis (1998) has already pointed out, the results 
depend upon the entropic index q and it is expected that, 
for every specific use, better discrimination will achieved 
with appropriate ranges of values of q. The appropriate 
choice of this parameter remains an open problem. We 
focus on this key problem. 

Recently, Solotongo-Costa and Posadas (2004) intro- 
duced a model for earthquke dynamics, which has been 
rooted in a noncxtensivc framework starting from first 
principles. The authors obtained the following analytic 
expression for the magnitude distribution of EQ: 



log(iV(m >)) = logN+ 



q 



1-q 



xloe 



l + a{q-l)x {2-qY 



(18) 

where N is the total number of EQs, N{m >) the 
number of EQs with magnitude larger than m, and 
TO ~ log(e). This is not a trivial result, and incorporates 
the characteristics of nonextensivity into the distribution 
of EQ by magnitude, a is the constant of proportional- 
ity between the EQ energy, e, and the size of fragment, 
r. More precisely, Solotongo-Costa and Posadas assume 
that e oc r. 

Solotongo-Costa and Posadas (2004) and Vilar et al. 
(2007) successfully tested the viability of this distribu- 
tion function with data in various different areas. The 
associated nonextensive parameter is distributed from in 
the narrow area from 1.60 up to 1.71. 

Importantly, we showed that the above mentioned 
nonextensive model also describes the sequence of pre- 
seismic kHz EM fluctuations (EM EQs) that detected 
prior to the Athens EQ (M = 5.9, September 7, 1999) 
(Papadimitriou et al., 2008). The associated parameter 
q is 1.80. In part II of this contribution we will show that 
the recorder kHz EM fluctuations prior to the L'Aquila 
EQ also described by the model proposed by Solotongo- 
Costa and Posadas with a g-parameter equal to 1.82. 

It is very interesting to observe the similarity in the 
q-values for all the caialogs of EQs used, as well as for 
the precursory sequences of kHz EM EQs associated with 
the activation of the Athens and LAquila faults. The 
aspects of self-affinc nature of faulting and fracture are 
well documented. The former finding is in full agreement 
with these fundamentals aspects (see Part II). 

Based on the aforementioned concepts, we estimate the 
Tsallis entropies with g-parameter equal to 1.8. Figure 
6 shows that the Tsallis entropies in the emerged strong 
EM bursts drop to lower values in comparison to that of 
the noise. This suggests that in the noise there are many 
kinds of patterns, while into the bursts there are fewer 
patterns. 

Fig. 7b shows the Tsallis entropy into the excerpts 

under study. The Shannon entropy is also shown, foe 
comparison reason. The Shannon entropy to clearly dis- 
criminate the anomalies from the noise. However, in the 
case where the bursts are responses of an underlying pro- 
cess which is characterized by by long-range interactions. 
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long-term memories, or multi-fractal nature, the Shan- 
non entropy has not any physical background. 

VI. T-ENTROPY OF A STRING 



the T-information the units of nats. lT{x{n)) is the T- 
information of string x{n). The average T-information 
rate per symbol, referred here as the average T-cntropy 
of x{n) and denote by hT{x(n)), is defined along similar 
lines, 



T-entropy is a novel grammar-based complexity / in- 
formation measure defined for finite strings of symbols 
(Ebeling et al., 2001; Tichener et al., 2005). It is a 
weighted count of the number of production steps re- 
quired to construct the string from its alphabet. Briefly, 
it is based on the intellectual economy one makes when 
rewriting a string according to some rules. 

An example of an actual calculation of the T- 
complcxity for a finite string is given in Ebeling et al.( 
2001). We briefly describe how the T-complexity is com- 
puted for finite strings. 

The T-complexity of a string is defined by the use 
of one recursive hierarchical pattern copying (RHPC) 
algorithm. It computes the effective number of T- 
augmentation steps required to generate the string. The 
T-complexity may be thus computed effectively from any 
string and the resultant value is unique. 

The string x{n) is parsed to derive constituent patterns 
Pi G and associated copy-exponents ki £ N~^,i = 
1, 2, q, where q G satisfying: 

x=p''g''p';r,\..p'^'...p1'ao, aoGA. (19) 
Each pattern pi is further constrained to satisfy: 



Pi = Pi-i 



-1 fll-i i- 

Pi-2 



'■■■Pi 



■■■Pi 



Oti 



ai €: A and < mjj < kj. 



(20) 



(21) 



The T-complexity CT{x{n)) is defined in terms of the 
copy-exponents k^: 



CT{x{n))=Y,Hki + l)^ 



(22) 



One may verify that CT{x{n)) is minimal for a string 
comprising a single repeating character. 

The T-information lT{x{n)) of the string x{n) is 
defined as the inverse logarithmic integral of the T- 
complexity divided by a scaling constant In 2: 



lT{x{n)) = li 



.1 f CTixjn)) 
[ ln2 



(23) 



In the limit n — > oo we have that lT{x{n)) < ln(#^"). 
The form of the right-hand side may be recognizable 
as the maximum possible n-block entropy of Shannon's 
definition. The neperian logarithm implicitly gives to 



hT{x{n)) = -^^^^^—^ {nats /symbol). 



n 



(24) 



A. Application to the data 

Figure 8 shows that the average T-cntropics in the 
emerged kHz EM activity dramatically drop to lower val- 
ues. 

This indicates that a significantly lower number of pro- 
duction steps are required in order to construct the string 
from, its alphabet into the em,erged strong EM bursts. In 
others words, the bursts are characterized by a consider- 
ably lower complexity in comparison to that of the normal 
epoch (EM background). 

To summarize, all the used tools that are rooted on the 
notion of symbolic dynamics with sensitivity discriminate 
and recognize the kHz EM anomalies from the EM back- 
ground. All the applied methods lead to the conclusion 
that the kHz EM bursts that emerged a few tens of hours 
prior to the L'Aquila EQ occurrence are characterized by 
a significantly lower complexity (or higher organization, 
higher predictability, lower uncertainty, higher compress- 
ibility) in respect to that of the EM background (noise). 

A question arises whether other tools absolutely re- 
ferring to raw data and not to corresponding symbolic 
sequences also lead to the above mentioned conclusion. 
In the following section we analyze the data by means of 
approximate entropy. 



VII. APPROXIMATE ENTROPY 

Related to time series analysis, ApEn provides a mea- 
sure of the degree of irregularity or randomness within 
a series of data (of length N). ApEn was pioneered by 
Pincus as a measure of system complexity (Pincus, 1991). 
It was introduced as a quantification of regularity in rel- 
atively short and noisy data. It is rooted in the work of 
Grassberger and Procaccia (1983) and has been widely 
applied in biological systems (Pincus and Goldberger, 
1994; Pincus and Singer, 1996 and references therein). 

The approximate entropy examines time series for sim- 
ilar epochs: more similar and more frequent epochs lead 
to lower values of ApEn. 

In a more qualitative point of view, given N points, the 
ApEn-\\ke statistics is approximately equal to the neg- 
ative logarithm of the conditional probability that two 
sequences that are similar for m points remain similar, 
that is, within a tolerance r, at the next point. Smaller 
ApEn-Mahies indicate a greater chance that a set of data 
will be followed by similar data (regularity), thus, smaller 
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values indicate greater regularity. Conversely, a greater 
value for ApEn signifies a lesser chance of similar data 
being repeated (irregularity), hence, greater values con- 
vey more disorder, randomness and system complexity. 
Thus a low / high value of ApEn reflects a high / low 
degree of regularity. Notably, ApEn detects changes in 
underlying episodic behaviour not reflected in peak oc- 
currences or amplitudes (Pincus and Keefe, 1992). 

The following is a description of the calculation of 
ApEn. Given any sequence of data points u{i) from i = 1 
to A'', it is possible to define vector sequences x{i), which 
consists of length m and are made up of consecutive u{i), 
specifically defined by the following: 



and the ratio of logarithms is equivalent to their differ- 
ence. A more comprehensive description of ApEn may 
be found in (Pincus, 1991; Pincus and Goldberger, 1994; 
Pincus and Singer, 1996). 

it In summary, ApEn is a "regularity statistics" that 
quantifies the unpredictability of fluctuations in a time 
series. The presence of repetitive patterns of fluctuation 
in a time series renders it more predictable than a time 
series in which such patterns are absent. A time series 
containing many repetitive patterns has a relatively small 
ApEn; a less predictable (i.e., more complex) process has 
a higher ApEn. 



x{i) = {u[i\,u[i + 1], ...,u[i + m - 1]). (25) 

In order to estimate the frequency that vectors x{i) 
repeat themselves throughout the data set within a tol- 
erance r, the distance (i(a;[«], j;[j']) is defined as the maxi- 
mum diff'erence between the scalar components x{i) and 
x{j). Explicitly, two vectors x{i) and x{j) are "similar" 
within the tolerance or filter r, namely (i(x[i], a;[j]) < 
r, if the difference between any two values for u{i) 
and u{j) within runs of length m are less than r (i.e. 
\u{i + k) — u{j + k)\ < r for < k < m). Subsequently, 
C™{r) is defined as the frequency of occurrence of similar 
runs m within the tolerance r: 

[number of j such that d(a;[i], x[j]) < r] 
^''> ^ {N-m-1) ' 

where j < {N — m — 1). 

Taking the natural logarithm of C^{r), $"*(r) is de- 
fined as the average of ln{C"^{r)): 

$™(r) = lnCY'{r)/{N - m - 1) (26) 

i 

where J2i is a sum from j = 1 to (A'' — m — 1). $'"(r) 
is a measure of the prevalence of repetitive patterns of 
length m within the filter r. 

Finally, approximate entropy, or ApEn{m, r, N), is de- 
fined as the natural logarithm of the relative prevalence 
of repetitive patterns of length m as compared with those 
of length m + 1: 

ApEn{m, r, N) = $'"(r) - <i>"'+\r). (27) 

Thus, ApEn{m, r, N) measures the logarithmic fre- 
quency that similar runs (within the filter r) of length 
m also remain similar when the length of the run is in- 
creased by 1. Small values of ApEn indicate regularity, 

given that i increasing run length m by 1 does not de- 
crease the value of $™(r) significantly (i.e., regularity 
connotes that ^™[r] f« $™+^[r]). ApEn{m,r,N) is ex- 
pressed as a difference, but in essence it represents a ra- 
tio; note that $™[r] is a logarithm of the averaged C™(r), 



A. Application to the data 

Figure 7a shows that the approximate entropy into the 
three excerpts of the emerged kHz EM activity prior to 
the L'Aquila EQ clearly drop to lower values in compar- 
ison to that of the noise. 

it This suggests that the candidate kHz EM precursors 
are governed by the presence of repetitive patterns which 
render them more predictable than noise in which such 
repetitive patterns are absent. This result verifies the 
conclusions extracted by the tools of symbolic dynamics. 

In oder to extract more different information probably 
hidden in the recorded kHz EM anomaly, in the next 
section we analyze the data in terms of fractal spectral 
analysis. 



VIII. ANALYSIS IN TERMS OF FRACTAL 
SPECTRAL ANALYSIS 

It is well known that during the EQ preparation pro- 
cess, the complex system of the Earth's manifests itself 
in linkages between space and time, producing character- 
istic fractal structures. It is expected that these fractal 
structures are mirrored in signals rooted in the EQ gener- 
ation. If a time series is a temporal fractal then a power- 
law of the form S{f) oc is obeyed, with S{f) the 
power spectral density and / the frequency. The spec- 
tral scaling exponent /? is a measure of the strength of 
time correlations. The goodness of the fit of a time series 
to the power-law is represented by the linear correlation 
coefficient, r, of this representation. 

Our attention is directed to whether distinct alter- 
ations in the associated scaling parameters emerge in 
kHz EM fluctuations. For this purpose, we applied the 
wavelet analysis technique in order to derive the coeffi- 
cients of its power spectrum. The wavelet transform pro- 
vides a representation of the signal in both the time and 
frequency domains. In contrast to the Fourier transform, 
which provides the description of the overall regularity 
of signals, the wavelet transform identifies the temporal 
evolution of various frequencies (i.e. as a time-frequency 
plane that indicates the frequency content of a signal 
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at every time). The decomposition pattern of the time- 
frequency plane is predetermined by the choice of the 
basis function. In the present study, we used the contin- 
uous wavelet transform with the Morlet wavelet as the 
basis function. The results were checked for consistency 
using the Paul and DOG mother functions (Torrence and 
Compo, 1998). 

The power spectral densities were estimated using a 
moving window of 256 samples and an overlap of 255 
samples. Finally, the spectral parameters r and j3 were 
calculated for each window. 

Fig. 9 shows that in the emerged strong kHz EM bursts 
on April 4 2009 the coefHcient r takes values very close to 
1, i.e., the fit to the power-law is excellent. This means 
that the fractal character of the underlying processes and 
structures is solid. This feature is compatible with a 
system close tp critical point. 

The (3 exponent takes high values, i.e., between 2 and 3 
into the strong EM fluctuations. This fact mirrors that: 

(i) The included EM events have long-range temporal 
correlations, namely, strong memory: the current value 
of the precursory signal is correlated not only with its 
most recent values hut also with its long-term history in 
a scale-invariant, fractal manner. Briefly, the data indi- 
cate an underling mechanism of high organization that is 
compatible with the last stage of EQ generation. 

(ii) The spectrum manifests more power at lower fre- 
quencies than at high frequencies. The enhancement of 
lower frequency fluctuations physically reveals a predom- 
inance of larger fracture events. This footprint is also in 
harmony with the final step of EQ preparation. 

(iii) Two classes of signal have been widely used to 
model stochastic fractal time series (Heneghan and Mc- 
Darby, 2000): fGn and fBm. For the case of the fGn 
model the scaling exponent (3 lies between -1 and 1, 
while the fBm regime is indicated by /3 values from 1 
to 3 (Heneghan and McDarby, 2000). The (3 exponent 
successfully identifies the candidate precursory activities 
from the EM noise. Indeed, the (3 values in the EM back- 
ground are between 1 and 2 indicating that the time profile 
of the EM time series during the quiet periods is quali- 
tatively analogous to fGn class. On the contrary, the /? 
values in the candidate EM precursors are between 2 and 
3, suggesting that the profile of the time series associated 
with the candidate precursors is qualitatively analogous 
to fBm class. 

We concentrate on the previous result. We emphasize 
that: 

(i) Theoretical and laboratory experiments support the 
consideration that both the temporal and spatial activity 
can be described as different cuts in the same underlying 
fractal (Maslov et al., 1994; Ponomarev et al., 1997). A 
time series of major historical events could have temoral 
and spatial correlations. 

(ii) It has been pointed out that fracture surfaces can 
be represented by self-afline fractional Brownian surfaces 
over a wide range (Huang and Turcotte, 1988). 

These two suggestions lead to the hypothesis that the 



fBm type profile of the precursory EM time series reflects 
the slipping of two rough and rigid Brownian profiles one 
over the other that leaded to the L 'Aquila EQ nucleation. 

In the part II of this contribution this consideration is 
f investigated in details. 

The (3 exponent is related to the Hurst exponent, H, 
by the formula [Turcotte, 1997]: 

p = 2H+l (28) 

with < < 1 (1 < /3 < 3) for the fractional 
Brownian motion (fBm) model (Heneghan and McDarby, 
2000). The exponent H characterizes the persistent / 
anti-persistent properties of the signal. 

The range 0.5 < iJ < 1 (2 < /? < 3) indicates persis- 
tency, which means that if the amplitude of fluctuations 
increases in a time interval it is likely to continue in- 
creasing in the immediately next interval. We recall that 
(3 values in the candidate EM precursors are between 2 
and 3. The H values are close to the value 0.7 in the 
strong excerpts of the kHz EM activity. This means that 
the included EM fluctuations are positively correlated or 
persistent. This suggests that the underlying dynam- 
ics is governed by a positive feedback mechanism, which 
tends to lead the system out of equilibrium under exter- 
nal effects (Telesca and Lasaponara, 2006). The system 
acquires a self-regulating character and to a great ex- 
tent the property of irreversibility, one of the important 
components of prediction reliability (Morgounov, 2001). 
Sammis and Sornette (2002) have recently presented the 
most important positive feedback mechanisms. 

It is expected that a positive feedback mechanism re- 
sults in finite-time-singularity. The kHz EM under study 
seems to show a such behaviour by means of "cumulative 
Benioff type EM energy release" (see Part II). Notice, a 
clear finite-time-singularity in terms of "cumulative Be- 
nioff type EM energy release" has been reported in the 
case of the Athens EQ (Kapiris et al., 2004). 

Remark. The H exponent also reveals the "rough- 
ness" of the time series. We pay attention to the fact 
that the H values in the strong kHz EM fluctuations are 
close to the value 0.7. Fracture surfaces were found to 
be self-affinc over a wide range of length scales (Man- 
delbrot 1982). The Hurst exponent H ~ 0.75 has been 
interpreted as a universal indicator of surface roughness, 
weakly dependent on the nature of the material and on 
the failure mode (Lopez and Schmittbuhl, 1998; Hansen 
and Schmittbuhl, 2003; Ponson et al., 2006). Thus, the 
universal spatial roughness of fracture surfaces is pretty 
mirrored in the roughness of the profile of strong pre- 
seismic kHz anomalies that have been emerged prior to 
the L 'Aquila EQ. 

We recall that Hurst proposed the R/S method in or- 
der to identify, through the H exponent, whether the 
dynamics is persistent, anti-persistent or uncorrelated. 
We wonder whether this method verifies the values of H- 
cxponent estimated by the fractal spectral analysis. We 
also wonder whether the hypothesis that the emerged 



11 



anomaly is further supported by another method, for ex- 
ample, Detrended Fractal Analysis. In the two next sec- 
tions we are dealing with the aforementioned two ques- 
tions. 



IX. RESCALED RANGE ANALYSIS: 
HURST EXPONENT 



THE 



The Rescaled Range Analysis (R/S), which has been 
introduced by Hurst, attempts to find patterns that 
might repeat in the future. Briefly, there arc two main 
variables used in this method, the range of the data (as 
measured by the highest and lowest values in the time 
period), and the standard deviation of the data. 

Hurst, in his analysis, first transformed the natu- 
ral records in time X{N) = x{l) , x{2) , . . . , x{N) , into 
a new variable y{n,N), the so-called accumulated de- 
parture of the natural record in time in a given year 
n(n — l,2,...iV), from the average, < a; > (n), over a 
period of N years. The transformation follows the for- 
mula 



y{n,N) = J2i^{z)-{x)) 



(29) 



i=l 



Then, he introduced the rescaled range 



R/S ■ 



RjN) 
S{N) 



(30) 



in which the range R{N) is defined as a distance be- 
tween the minimum and maximum value of y by 



R{N) 

and the standard deviation S{N) by 



(31) 



S{N) 



\ 



1 ^ 

-^b(z)-(x)]2 (32) 



R/S is expected to show a power-law dependence on 
the box size n: 



R{n)/S{n) r^nH, (33) 
where H is the Hurst exponent. 

A. Application to the data 

Fig. 7 shows that the R/S technique applied directly 

on the raw data may be of use in distinguishing "candi- 
date pathological" from "healthy" data sets in terms of 



H exponent. The "healthy" data (EM background) are 
characterized by antipersistency. In contrast, the "candi- 
date pathological" data sets are characterized by strong 
persistency. 

We empasizc, that the H exponents derived from the 
relation (3 = 2H + 1, which is valid for the fBm-model, 
follow quite nicely those estimated by the R/S analysis. 
This consistency supports the hypothesis that the candi- 
date EM precursors follow the fBm-model. 



X. DETRENDED FLUCTUATION ANALYSIS 

Often experimental data are affected by non- 
stationarities, and strong trends in the data can lead to a 
false detection of long-range correlations if the results are 
not carefully interpreted. The DFA, proposed by Peng et 
al. (1993, 1994, 1995) and based on random walk theory, 
is a well-established method for determining the scaling 
behaviour of noisy data in the presence of trends without 
knowing their origin and shape. 

We briefly introduce the DFA method, which involves 
the following six steps: 

(i) We consider a time scries of i = 1,...,N of length 
N. In most applications, the index i will correspond 
to the time of measurements. We are interested in the 
correlation of the values Xi and Xi^k for different time 
lags, i.e. correlations over different time scales k. In the 
first step, we determine the integrated profile 



y{k) = Y,'^x{i) - {x)),i 



(34) 



where (...) denotes the mean. 

(ii) The integrated signal y{k) is divided into non- 
overlapping boxes of equal length n. 

(iii) In each box of length n, we fit y{k), using a poly- 
nomial function of order I, which represents the trend in 
that box. We usually use a linear fit. The y coordinate 
of the fit line in each box is denoted by yn{k). 

(iv) The integrated signal y{k) is detrended by sub- 
tracting the local trend yn{k). Then we define the de- 
trended time series for boxes duration n, denoted by 
yn{k) = y(k) - yn{k). 

(v) For a given box size n, the root-mean-square (rms) 
fluctuations for this integrated and detrended signal is 
calculated: 



F{n) = 



1 ^ 



fc=i 



(vi) The aforementioned computation is repeated for a 

broad range of scales box sizes (n) to provide a relation- 
ship between F{n) and the box size n. 
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A power-law relation between the average root-mean 
square fluctuation F{n) and the box size n indicates the 
presence of scaling: 

F{n) ~ n" (36) 

The scaling exponent a quantifies the strength of the 
long-range power-law correlations in the time series. 

A. Application to the data 

We fit the experimental time series by the function 
F{n) ~ n". In a logF{n) — logn representation the for- 
mer function is a line with slope a. We note that the 
scaling exponent a is not always constant (independent 
of scale) and crossovers often exist, i.e., the value of a 
differs for long and short time scales. In order to ex- 
amine the probable existence of crossover behaviour, the 
short-term scaling exponent ai and the long-term scal- 
ing exponent 0:2 were estimated into the noise N and the 
exsepts Bl, B2, and B3. 

Following Peng et al., (1995) in Fig. 10 we show the 
scatter plot of scaling exponents ai vs a2. The behaviour 
of these two exponents clearly separates the EM noise 
from candidate EM precursors. The three bursts are 
characterized by much larger ai and 0:2 values. More 
precisely, in the noise the two exponents have values close 
to 1 indicating an underlying l//-typc noise. On the con- 
trary, the three bursts show exponents higher to 1 and 
close to 1.5, pretty close to that of a fBm (a2 ^ 1.5) 
(Peng et al., 1995). 

This finding also mirrors that kHz EM fluctuations are 
governed by strong long-range power-law correlations in- 
ductive of an underlying positive feedback mechanism, 
which has a propensity to lead the system out of equilib- 
rium under external effects. 

The analysis also shows that the candidate EM precur- 
sors do not exhibit a clear crossover in scaling behaviour, 
both the as and ai exponents have values pretty close to 
that (1.5) of a fBm. Finally, the application of the DFA 
to data verifies that the strong kHz activities follows the 
fBm-model. 



XI. VIEW OF CANDIDATE PRECURSORY 
PATTERNS IN TERMS OF THEORY OF 
COMPLEXITY 

Earthquake occurrence is a complex phenomenon in 
space and time. The field of study of complex systems 
holds that the dynamics of complex systems is founded on 
universal principles that may used to describe disparate 
problems ranging from particle physics to the economics 
of societies (Stanley, 1999, 2000; Stanley et al., 2000; 
Vicsek, 2001, 2002). 

The study of complex system in a unified framework 
has become recognized in recent years as new scientific 



discipline, the ultimate of interdisciplinary fields. Char- 
acteristically, de Arcangelis et al. (2006) presented evi- 
dence for universality in solar flare and EQ occurrence. 
Picoli et. al. (2007) reported similarities between the 
dynamics of geomagnetic signal and heartbeat intervals. 
Kossobokov and Keilis-Borok (2000) have explored simi- 
larities of multiple fracturing on a neutron star and on the 
Earth, including power-law energy distributions, cluster- 
ing, and the symptoms of transition to a major rupture. 
Sornette and Helmstetter (2002) have presented occur- 
rence of finite-time singularities in epidemic models of 
rupture, EQ, and starquakes. Kapiris et al., (2005) and 
Eftaxias et al., ( 2006) reported similarities in precursory 
features in seismic shocks and epileotic seizures. Osario 
et al. (2007) have suggested that that epileptic seizure 
could be considered as quakes of brain. Fukuda et al., 
(2003) reported similarities between communication dy- 
namics in the Internet and the automatic nervous system. 

Breaking down the barriers between physics, chemistry 
and biology and the so-called soft sciences of psychology, 
sociology economics, and anthropology, this approach ex- 
plores the universal physical and mathematical principles 
that govern the emergence of complex systems from sim- 
ple components (Bar-Yan, 1997; Sornette, 2002; Rundle 
et al., 1995). 

One of the issues that we will need to address is whether 
the crucial pathological symptoms of low complexity and 
persistency included in the candidate kHz EM precursor 
also characterize other, different, however, in their na- 
ture, catastrophic events. 

We investigate the probable presence of the above men- 
tioned pathological symptoms in epileptic seizures, mag- 
netic storms, solar flares. 



A. Similarities between the dynamics of magnetic 
storm and EM precursors 

Intense magnetic storms are undoubtedly among the 
most important phenomena in space physics interlinking 
the solar wind, magnetosphere ionosphere, atmosphere 
and occasionally the Earth's crust (Daglis, 2001; Daglis 
et al., 2003). The Dst index is a geomagnetic index which 
monitors the world-wide magnetic storm level. It is ex- 
pressed in nanoteslas and is based on the average value 
of the horizontal component of the Earth's magnetic field 
measured hourly at four near-equatorial geomagnetic ob- 
servatories. 

In recent works Balasis et al. (2006, 2008, 2009a, 
2009b) studied Dst data (2001) which include intense 
magnetic storms, as well as a number of smaller events. 
Therein, we have applied the majority of the techniques 
that have been used in the present work. The results 
show that all the extracted crucial features from the kHz 
EM activity under study (e.g., long-range correlations, 
persistency, appearance of fluctuations at all scales with a 
simultaneous predominance of large events) are also hid- 
den in intense magnetic storms. We have suggested that 
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the development of both intense magnetic storm or kHz 
EM can be studied in a unified framework, i.e.. within 
the school of the Intermittent Criticality. This school has 
a more general character than the classical self-organized 
criticality, implying the predictability of the impending 
catastrophic event. 

In Part II of this contribution more quantitative evi- 
dence of universal behaviour between the kHz EM pre- 
cursors under study and intense magnetic storms is pre- 
sented. We emphasize that based on previously de- 
tected kHz EM pre-seismic anomalies, we have already 
shown that the kHz EM precursors and magnetic storms 
share common scale- invariant natures (Papadimitriou et 
al., 2008; Balasis et al., 2009a). The relevant analysis is 
based on the nonextensive model of EQ dynamics pre- 
sented by (Solotongo-Costa and Posadas, 2004). 



B. Similarities between the epileptic seizures and 
EM precursors 

Theoretical studies suggest that the final EQ and 
neural-seizure dynamics should have many similar fea- 
tures and could be analyzed within similar mathematical 
frameworks (Hopfield et al., 1994; Rudle et al., 1995; 
Herz and Hopfield, 1995). Recently, we studied the tem- 
poral evolution of the fractal spectral characteristics in: 
(i) electroencephalograph (EEG) recordings on rat ex- 
periments included epileptic shocks, and (ii) pre-seismic 
kHz EM time series detected prior to the Athens EQ. We 
showed that similar distinctive symptoms (including all 
the observed in the present study precursory symptoms) 
appear in epileptic seizures and EM precursors(Kapiris et 
al., 2005: Eftaxias et al., 2006). Importantly, we propose 
that these two observations also find a unifying explana- 
tion within the school of the Intermittent Criticality. 

We notice that recently, Osorio et al., (2007) have 
tested the universal hypothesis on the Earth's crust and 
the epileptic brain suggesting that epileptic seizures could 
be considered as quakes of the brain. 



C. Similarities between solar flares and EM 
precursors 

In a recent work Koulouras et al. (2009) investigated 
MHz EM radiations rooted in solar flares. A compar- 
ative study show that these emissions include all the 
extracted precursory features from the kHz EM emis- 
sion under study via the fractal spectral analysis. Im- 
portantly, the solar activity follows the "persistent fBm 
model" , while persistent behaviour is not found in quiet 
Sun observations. Schwarz et al. (1998) verify this re- 
sult: they showed that the time profiles of solar mm- wave 
bursts are qualitatively analogous to fBm model showing 
persistent behaviour. Notice, de Arcangelis et al. (2006) 
presented evidence for universality in solar fiare and EQ 
occurrence, while Papadimitriou et al. (2008) reported 



indications for universality in kHz pre-seismic EM activ- 
ities and EQ. 

In a forthcoming paper we successfully test the univer- 
sal hypothesis on the kHz EM anomalies detected prior to 
the L'Aquila EQ and solar flares. The relevant analysis 
is also based on the nonextensive model of EQ dynamics 
presented by (Solotongo-Costa and Posadas, 2004). 

In summary, the kHz EM precursors under study, 
epileptic seizures, solar flares, and magnetic storm,s in- 
clude "universal" symptoms in their internal structural 
patterns. These symptoms clearly recognize these catas- 
trophic events from the corresponding normal state. 



XII. CONCLUSIONS 

A sequence of ULF, kHz and MHz EM anomalies 
recorded at Zante station, from March 26 2009 up to 
April 4 2009, namely prior to the L'Aquila EQ that oc- 
curred on April 6 2009. Our effort is focused on the ques- 
tion whether the recorded anomalies are seismogcnic or 
not. Notice, we investigate not only whether or not a 
single kHz, MHz, or ULF EM anomaly is pre-seismic in 
itself, but mainly whether a combination of such anoma- 
lies can be characterized as pre-seismic. Our approach is 
based on the following open key questions: How we can 
recognize an EM observation as a pre-seismic one. How 
we can link an individual EM precursor with an equiv- 
alent distinctive stage of EQ preparation. How we can 
identify precursory symptoms in EM observations that 
witness that the occurrence of the prepared EQ is un- 
avoidable. 

In this Part I of our contribution, we restrict ourselves 
in the study of the recorded sequence of kHz EM anoma- 
lies. The pre-seismic kHz anomalies have a crucial role in 
the frame of our work (e.g Kapiris et al., 2004, Contoyian- 
nis et al., 2005; Eftaxias et al., 2007; Papadimitriou et al., 
2008). We attempt to approach the remaining question 
in Part II. 

Based on a multidisciplinary investigation, we argue 
that the emerged sequence of kHz anomalies clearly are 
recognized and discriminated by the EM background in 
region of the station. In order to develop a quantitative 
identification of a kHz EM anomaly, concept of entropy 
and tools of information theory have been used in order to 
identify statistical patterns: a significant change in the 
statistical pattern represents a deviation from the nor- 
mal behaviour revealing the presence of an anomaly. In 
principle one cannot find an optimum tool for anomaly 
detection. A combination of various tools seems to be 
a promising way to get a more precise recognition of a 
recorded anomaly as a pre-seismic one. We analyzed the 
associated kHz EM time series in terms of Shannon n- 
block entropy, differential or conditional entropy, entropy 
of the source or limit entropy, Kolmogorov-Sinai entropy, 
T-entropy, and nonextensive Tsallis entropy. For com- 
parison reasons, we applied a more tool to the data, 
namely, approximate entropy which refers directly to the 



14 



raw data and not to a transformed symbolic sequence. 
We conclude that all the applied methods sensitively rec- 
ognize the launched candidate kHz EM from the nor- 
mal state (EM background): they are characterized by 
a considerably lower complexity (or higher organization, 
lower uncertainty, higher predictability, higher compress- 
ibility) in comparison to that of EM background (noise). 
The spectral fractal technique further discriminates the 
anomalies from the noise. The candidate precursors fol- 
low the persistent fBm-model, while the noise tracks the 
1/f-noise model. We verify the existence of persistency 
into the anomalies by the R/S analysis. The suggestion 
that the candidate precursors follow the fBm-model is 
verified by means of dctrcnded fractal analysis. 

The fact that the launch of anomalies from the normal 
state is combined by (i) a simultaneous appearance of a 
significantly higher organization, and (ii) persistency, in- 
dicates that the process, where the anomalies are rooted, 
is governed by a positive feedback mechanism. This 
mechanism is inductive of an out of equilibrium process, 
i.e., catastrophic event. 

In this field of research, the reproducibility of results is 
desirable. Importantly, the included catastrophic symp- 
toms in the candidate kHz EM precursors under study 
are also included in rather well established kHz EM pre- 
cursors associated with significant EQ that recently oc- 
curred in Greece (e.g Kapiris et al., 2004, Contoyiannis 
et al., 2005; Eftaxias et al., 2007; 2008; Kalimeri et al., 
2008) . 

The field of study of complex systems holds that 
their dynamics is rooted in universal principles that may 
used to describe disparate problems ranging from par- 
ticle physics to the economics of societies. Evidence 
showed that the low complexity and persistency common 
footprints in other catastrophic events, namely, neural- 
seizures, magnetic storms, and solar flares. Part II of this 
communication further supports the hypothesis that kHz 
EM precursors, solar flares, magnetic storms and epilep- 
tic seizures could be investigated in a unified framework. 

We wonder whether the clear discrimination of the 
emerged prior to the L'Aquila EQ kHz EM anomalies 
from the normal state, even based on a combination of 
(i) a rather strong statistical analysis, and (ii) striking 
similarities with other complex catastrophic events, re- 



liably leads to the conclusion that these anomalies are 
rooted in the preparation of the L'Aquila EQ. 

Our view is that such an analysis by itself cannot es- 
tablish an anomaly as precursor and even more identify a 
corresponding characteristic stage in the EQ preparation 
process. It probably offers sufficient but not necessary 
criteria in order to recognize an anomaly as pre-seismic 
one. 

Much remains to be done to tackle systematically pre- 
cursors. It remains to be established whether different 
approaches could provide additional information that al- 
lows one to accept the seismogenic origin of the recorded 
kHz EM anomalies and correspond these to a distinguish- 
ing stage of EQ generation. 

Fracture process is characterized by fundamental uni- 
versally valid scaling relationships. In particular, the as- 
pects of self-afhne nature of faulting and fracture have 
been well-established. Our point of view is that such fun- 
damental structural patterns of fracture and faulting pro- 
cess should be reflected on a real fracto-electromagnetic 
activity. Thus, their potential existence in the candidate 
precursor would be a strong footprint of its seismogenic 
origin. In Part II of this communications we show the ex- 
istence of such structural precursory patterns in the can- 
didate kHz. In part II, based on the strategy described 
in Introduction, we complete our study. More precisely, 
an important pursuit is to make a quantitative compari- 
son between pre-seismic EM time series and fracture sur- 
faces. We support the seismogenic origin of the detected 
MHz EM anomalies. We try to correlate the kHz and 
MHz EM anomalies with distinctive last stages of the 
LAquila preparation process. It is a risky practice to 
extend findings rooted in laboratory experiments to geo- 
physical scale. However, one can not ignore a comparison 
between failure precursors at laboratory and geophysical 
scale. Finally, the reproducibility of results is desirable 
in this field of research. We refer to this requirement. 
Finally, we discuss the conditions that favourable the de- 
tection of kHz-MHz EM emissions rooted in a fracture 
process in the focal area. We explore this requirement in 
terms of fractal electrodynamics, which combines fractal 
geometry with Maxwells equations. It is a difficult task 
to separate two events, such as a candidate precursor and 
the ensuing EQ, separated in time. 
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FIG. 1: The critical excerpts of the 41 MHz magnetic field 
strength time series on March 26 2009 (upper panel) and 
April 2 2009 (lower panel), respectively. The EM fluctu- 
ations included in each time interval behave as a continu- 
ous (second order) phase transition in striking similarity with 
the behaviour of corresponding MHz EM precursors detected 
prior to other significant EQ that recently occurred in Greece 
(Contoyiannis ct al., 2005). Their critical behaviour has been 
investigated by means of a recently introduced method of 
critical fluctuations (Contoyiannis and Diakonos, 2000; Con- 
toyiannis, Diakonos, and Malakis, 2002). 
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FIG. 2: (a) We observe the presence of a sequence of strong 
EM impulsive bursts at 10 kHz on April 4 2009. (b) These 
anomalies are launched over a quiescence period concerning 
the detection of EM disturbances at the kHz frequency band. 
A segment from the EM background (N) and three excerpts 
of the emerged strong kHz EM activity (Bl, B2, B3) have 
been marked in the time series of April 4 2009. 




FIG. 3: Magnified images of tfie excerpts N, Bl, B2, and B3 
tliat are shown in Fig. 2. 
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FIG. 4: The time series of the ULF electric field strength, as 
it was recorded by the STWA sensors. 



FIG. 5: The Shannon n-block entropy H{n), conditional en- 
tropy H{n + 1) — H{n), Shannon n-block entropy per letter 
H{n)/n and Kolmogorov-Sinai entropy {h/ln2) as a function 
of word length n, into the background noise (N) and the three 
candidate precursory EM bursts Bl, B2, B3 for lumping (up- 
per panel) and gliding (lower panel). All these symbolic en- 
tropies for either reading techniques show a significant drop 
of complexity into the EM bursts with respect to the noise. 
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FIG. 6: The normalized Tsallis entropy has significantly lower 
values in the candidate EM precursors Bl, B2, and B3 in com- 
parison to that of the noise N. We recall that broad symbol- 
sequence frequency distributions produce high entropy val- 
ues, indicating a low degree of organization. On the contrary, 
when certain symbol sequences exhibit high frequencies, lower 
entropy values are produced, indicating a high degree of or- 
ganization. We conclude that the bursts Bl, B2, and B3 are 
characterized by higher organization in respect to that of the 
noise N. 




FIG. 7: For comparison reasons, we present the values of 
ApEn, Hurst exponent estimated by R/S analysis, Tsallis en- 
tropy and Shannon entropy for Bl, B2, B3 and N. The values 
of ApEn significantly decrease in the three EM bursts Bl, 
B2, B3 with respect to the noise (N). Smaller ApEn-veilues 
indicate a greater chance that a set of data will be followed 
by similar data, thus, the smaller values in the EM bursts 
indicate greater regularity. The Hurst-exponent estimated by 
R/S analysis also clearly separates the EM noise N from can- 
didate EM precursors Bl, B2, and B3. The candidate EM 
precursors sre characterized by persistency. On the contrary, 
the noise N follows the fGn model. Taken together the higher 
organization indicated by the ApEn and persistency indicat- 
ing by H exponent we conclude that the EM bursts are as- 
sociated with a positive feedback mechanism which leads the 
system out of equilibrium. Shannon and Tsallis entropies are 
also indicative for higher organization in the EM bursts. 




FIG. 8: Values of normalized T-entropy for time intervals A 
and B (upper and lower panel, respectively). Time intervals A 
and B are defined in Figure 6. In the case of burst we observe 
that less production steps are required in order to construct 
the string from its alphabet. 
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FIG. 9: From top to bottom are shown the 10 kHz time se- 
ries, spectral exponents /3, linear correlation coefficients r, 
and the wavelet power spectrum from 12:00:00 3 April 2009 
to 12:00:00 5 April 2009. The red dashed line in the f3 plot 
marks the transition between anti-persistent and persistent 
behavior. We observe that in the emerged strong kHz EM 
bursts the coefficient r takes values very close to 1, i.e., the 
fit to the power-law is excellent. This means that the fractal 
character of the underlying processes and structures is solid. 
The P exponent takes high values, i.e., between 2 and 3, fol- 
lowing the fBm model. This fact mirrors that: (i) the included 
EM events have strong memory; (ii) the spectrum manifests 
more power at lower frequencies than at high frequencies, in 
other words a predominance of large fracture events; and (iii) 
follows the fBm model. We emphasize that the strong EM 
fluctuations are governed by persistency. This is verifled by 
the R/S analysis (Figure 7). On the contrary, the background 
behaves as l//-type noise. 
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FIG. 10: The scatter plot of scaling exponents ai vs a-z clearly 
separates the EM noise N (denoted by a star) from candidate 
EM precursors Bl (square), B2 (triangle), and B3 (circle). In 
the noise the two exponents have values close to 1 indicating 
an underlying l//-type noise. On the contrary, the three 
bursts show exponents higher to 1 and close to 1.5, pretty 
close to that of a fBm (q2 ~ 1.5). 



